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This study proposed to examine the effectiveness of television instruction as 
compared with three other methods of instruction. Twenty-six sections of Speech 116 
at Purdue University were divided into five groups of five or six sections each. All 
sections met 3 times weekly, and the research was conducted during a consecutive 
8-day period. The students were exposed to expository material on small group 
discussion through one of four ways; observing a television lecture, listening to the 
identical lecture read from a manuscript by their regular instructors, reading the 
televised lecture individually, or receiving normally scheduled instruction by their 
instructors. A control group received no instruction on the topic. A true experimental 
pre-test — post-test control group design was employed, with the use of "t” test and 
analysis of variance (single factor) procedures. Results showed that televised 
instruction was just as efficient as the other methods used, and that no method was 
superior to any other one. Although certain limitations might have influenced the 
results, it is concluded that there is no reason to condemn television as an inferior 
method of instruction. (SW) 
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SOME EFFECTS OF TELEVISED INSTRUCTION 
ON A BASIC SPEECH COURSE' 

Robert S. Coyer and Earl R. Harlan 



HE effectiveness (measured by de- 
gree of learning) of television as a 
medium of instruction over a wide 
spectrum of subject matter content has 
been well established, although by no 
means is the verdict unanimous. Though 
systematic research in this area has em- 
ployed a variety of study techniques 
of variable rigor and’ effectiveness, sur- 
veys by Allen 2 and Kumata 3 indicate 
that learning is typically as great from 
television instruction as from more con- 
ventional methods, and sometimes signif- 
icantly greater. These results have de- 
rived from studies at virtually all grade 
levels of instruction; the subject matter 
areas involved in the reports have in- 
cluded primarily the physical and social 
sciences, the biological sciences, and 
mathematics. Such research typically has 
been motivated by the attempt to dis- 
cover and perfect ways and means of 
dealing with increased student popu- 
lations without a commensurate increase 
in the teaching population. 

Although research in our discipline 

Robert S. Coyer (Ph. D., The Ohio State Uni- 
versity, 1955) is Professor of Speech Communi- 
cation and Director of the Center for Com- 
munication Studies, Ohio University. Earl R- 
Harlan (M.S. Ed., Drake University, 1946) is 
Professor of Speech, Purdue University. 

t Credit is deserved by many who made con- 
tributions to the study on which this report is 
based. Especially to be noted is the assistance 
of Professor Bruce Kendall, who prepared and 
delivered the televised lecture; and Mr. Ray- 
mond Wolf, instructional television supervisor 
at Purdue. 

2 William H. Allen, "Audio-Visual Communi- 
cation, 1 * Encyclopedia of Education Research 
(New York: The Macmillan Co., i960), pp. 
115**7. 

aHidcya K uniats, An Inventory of Instruct 
tional Television Research (Ann Arbor: Edu- 
cational Television and Radio Center, 1956). 
*55 P- 



on the effects of televised instruction has 
not been extensive, some has been re- 
ported in the areas of oral interpretation, 
general communication skills, and funda- 
mentals of public speaking. In addition. 
Central Michigan Universty in i960 
embarked on an extensive three-year 
program of teaching its beginning speech 
course via closed circuit television under 
a grant from the Ford Foundation. 
Broadly summarized, the results of these 
studies suggest that experienced teachers 
make the most effective television in- 
structors; 4 students can achieve skill in 
speaking, writing, reading and listening 
equally well from "normal,” "bibliog- 
raphy,” or "kinescope” methods of in- 
struction; 5 although students achieved 
as well from televised instruction as 
from other conventional instruction, 
they didn’t "like” the former as well as 
the letter; 6 adapting the basic course to 
the medium of television resulted in 
improved dissemination of content 
materials through better quality lecture- 
demonstration techniques. 

Purposes of the Study 

The basic question examined in this 
research was, With the existing physical 

4 Martin T. Cobin and Theodore Clevenger, 
jr. t "Television Instruction, Course Content, and 
Teaching Experience Level: An Expci internal 
Study in the Basic Course in Oral Interpreta- 
tion.” Speech Monographs, XXVIII (Match 
1961). 16-20. 

5 Samuel L. Becker and Carl A. Dallingcr. 
"The Effect of Instructional Methods Upon 
Achievement and Attitudes in Communication 
Skills,” Speech Monographs, XXVII (March 
i960). 70-76. 

OKing Broadrick, Charles J, McIntyre, and 
Richard Moren, "TV Teacher's Report,” The 
Speech Teacher, XI (March 1963). 153-137- 
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facilities at Purdue University, can a 
selected body of expository material 
typically offered in Speech 1 16 (Funda- 
mentals of Expression) be offered as ef- 
fectively by television instruction as by 
selected other means? "Effective tele- 
vision instruction" is defined here as that 
which results in measured student 
achievement which is not significantly 
different from that obtained with com- 
parable students instructed by other 
selected means. Specifically, the follow- 
ing hypothesis was generated: 

Student achievement as measured will not be 
different in comparable student groups re- 
ceiving televised and other forms of instruction 
concerning expository material pertaining to 
small group discussion. 

Procedures of the Study 

Twenty-six sections of Speech 116 
were divided into five groups (A, B, C, 
D, E) of five or six sections each. Stu- 
dents taking the course are assigned to 
sections by computer on no systematic 
basis other than the avoidance of 
schedule conflicts with other courses. 
At the time of the study, sections 
ranged in size from 15 to 20 students 
each. All sections met three times week- 
ly: eighteen met on Monday-Wednesday- 
Friday, the other eight on Tuesday* 
Tlimsday-Snlurday. The research was 
conducted during a consecutive 8-day 
period. 

During the first three days an achieve- 
ment test measuring knowledge of prin- 
ciples of small group discussion as taught 
in Speech 116 was administered to all 
students in all sections. The unit of in- 
struction on small group discussion 
had not been taught as yet by any in- 
structor in the course. The test consisted 
of 23 items, each one of the multiple- 
choice objectively scored type. Upon 
receipt of the test data, difficulty indices 
and discrimination indices (phi cotffi* 
dents) were computed for each item. 



On the basis of this analysis three items 
were rejected as unsatisfactory, leaving 
a test of 20-itcms in length. All papers 
were then rescored on the basis of this 
20-item test, which was subsequently re- 
structured with the identical items and 
used as the post-treatment test. 

During the fifth and sixth days, three 
groups (A, B, C) of sections as pre- 
viously divided were exposed to the 
stimulus material in one of three ways, 
as follows: 

Group A observed a television lecture (video- 
taped) on the topic of group discussion in one 
of several television-rcccivcr-equipped classrooms 
located in the building in which all Speech 
Department courses are taught at Purdue. This 
room was not their regular classroom, but al- 
most, identical to it physically. The lecture was 
observed during their regular class period. Six 
sections comprised Group A. Immediately fol- 
lowing the presentation, the post-test was ad- 
ministered. 

Group B sections (six in all) listened to the 
identical lecture read from manuscript by their 
regular instructor, at their regular classroom 
and meeting time. Immediately following the 
presentation, the post-test was administered. 

Group C sections (five in all) read the tele- 
vised lecture individually and silently to them- 
selves, at their regular classroom and meeting 
time. During the last 15 minutes of the period, 
the post-test was administered. 

Of the remaining sections. Group D (con- 
sisting of five sections) received its normally 
scheduled instruction by its own instructors, 
wiiicii included tor an sections in this group the 
presentation by the individual instructors of 
the discussion material covered in the televised 
lecture. These instructors did not have access 
to the televised lecture manuscript, and presum- 
ably presented the material in their typical or 
"normal” manner. All sections in this group 
received this instruction on the last day; during 
the last 15 minutes of the period, the post-test 
was administered. 

Group E, consisting of four sections, received 
no instruction on the topic either- before or dur- 
ing the research period. Two sections in this 
group received the post-test during their reg- 
ular class meeting on the fifth day, and the 
other two sections during their regular class 
meeting on the last day. 
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Analysis of Results 



1. The Test Instrument. The reliabil- 
ity (internal consistency) of the pre- 
treatment test form was determined 
based on the analysis of the combined 
answer sheets of five sections, one sec- 
tion chosen randomly from each of 
the five groups (A,B,C,D,E). A similar 
procedure was employed to determine 
the reliability of the post-treatment form. 
The results are noted in Table I. 



TABLE I 



Internal Consistency Correlation Coefficient! 
for Pr~-Treatment ano Post-Treatment 








-T! k 




N 


r 


Frc-Trrzlitirnt 


80 


XT’] •• 


Fost-Trrafiiicitt 


72 


.68+ .06** 



•CrK-HicicnM computed |>y tlic split-half tech- 
nique, ami corrected for length. 

‘’•Significantly different from zero beyond 
the .01 level of confidence. 



By employing Fisher’s 7 z conversion to 
each obtained r, the standard t-ratio test 
to measure the significance of the dif- 
ference between the correlations was 
computed, producing a t value of .305. 
Since this value does not approach sig- 
nificance, it was concluded that the two 
forms were equally reliable in the situa- 
tions employed. 

2. The Hypothesis. In order to max- 



imize the precision of the analysis, it was 
decided to select randomly for purposes 
of comparison the responses of 25 sub- 
jects who had completed both tests, 
from each of the five groups. A summary 
of the test performances of each group is 
found in Table II. 

Before analyzing the effects of die ex- 
perimental treatments on learning, the 
pre and post scores of the control group 
were compared for possible significance 
by means of the t-test for related meas- 
ures. The computed t value was 1.18 (24 
d.f.), which does not approach signifi- 
cance. .It therefore was concluded that 
there was no reason to assume that the 
act of taking the pre-treatment test 
would significantly affect the post-treat- 
ment test scores. 

In order to determine the probabil- 
ity that the pre-treatment test samples 
from each group were indeed from a 
common population, the t test was ap- 
plied to the difference between the larg- 
est mean (Group D, 13.00) and the 
smallest mean (Group A, 11.88) on the 
pre-treatment test scores. The computed 
value was 1.33 (48 d.f.), which does not 
approach significance. It was therefore 
concluded that all the samples used in 
the experiment were indeed from a 
common population, based on a compar- 
ison of sample means on the pre-treat- 
ment test. 



7 Je«»- •• B. Mayhew, “The Beginning Course 
in Fundamentals of Speech as Taught by Closed 
Circuit Instructional Television at Central 
Michigan University,” Mimeographs (Mount 
Pleasant, Michigan: Central Michigan Univer- 
«>ty, 1963), 9 p. 



As a final precaution before applying 
the analysis of variance technique to 
the treatment data, both the pre-treat- 
ment and post-treatment test data were 



TABLE II 



Summary Performance Data on Pre-Treatment and Post-Treatment 

Tests of Achievement 



Group 



Score Range 
Pre Post 



Mean Score 
Pre Post 



Standard Deviation 
Pre Post 



A 

B 

C 

D 

E 



5*19 


1 1*20 


n.88 


16.28 


3.14 


*•54 


6-18 


IO-18 


12.20 


* 5 - 5 * 


2.51 


2.18 


6-18 


1 J-20 


12.52 


16.52 


2.83 


1.77 


9*'9 


12*20 


13.00 


16.08 


2.70 


2.00 


8-17 


9-18 


12-48 


13.04 


*•79 


2.84 
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examined for homogeneity of variance. 
Since all samples involved equal num- 
bers of cases, Bartlett’s test as described 
by Edwards 9 was applied, producing re- 
sults confirming the fact of homogeneity 
of variance among all samples in the 
pic-treatment test situation (x 2 = .o.j, 
with 4 dX), and in the post-test situa- 
tion (x 2 =i.2, with 4 dX). Thus, any 
differences that appeared among the 
sample means on the post-treatment test 
could be attributable to the treatment 
itself. 

A simple analysis of variance (single 
factor) procedure was applied to the 
data from the experimental samples 
(Groups A,B,C,D), with results as sum- 
marized in Table III. 

Clearly, there was no advantage for 
any one method of presenting the expos- 
itory material on small group discussion 
for the students used in this experiment. 

The final question to be asked was 
whether or not the difference between 
the mean gains in performance for the 
control group and the experimental 
groups was significant. In other words, 
did the treatments have any real effect 
on the amount of learning that oc- 
curred? Since the analysis of variance 
involved but a single factor, and since 
the samples were randomly drawn, an 
appropriate test to employ here was, 
once again, the t test. In this situation 
the mean gain in test score for the con- 
trol group (0.5(1) was compared with 
the smallest mean gain among the four 

8 Allen L. Edwards, Experimental Design in 
Psychological Research (New York: Rinehart 
and Co., Inc, 1950), p. 285. 



experimental groups, which was that of 
Group D (3.0S). The computed t value 
was 3.86 (48 dX), which was significant 
beyond the .01 level of confidence. 
Thus, it was concluded that the experi- 
mental treatments had a significantly 
positive effect on the immediate learn- 
ing (recall) of the subjects involved. 

Summary 

This study proposed to examine the 
relative effectiveness of four different 
methods of presenting expository ma- . 
tevial on small group discussion to ran- 
domly chosen groups of students in the 
Speech 116 program at Purdue Univer- 
sity, compared with a control group re- 
ceiving no instruction. A true experi- 
mental pre-test — post-test control group 
design was employed, with the use of t 
test and analysis of variance (single fac- 
tor) procedures. 

The results of the experiment clearly 
suggest that the hypothesis presented 
earlier cannot be rejected; that is, for the 
subjects in this experiment televised in- 
struction proved as efficient as having the 
material read aloud, reading the ma- 
terial silently to oneself, or receiving 
the material in ‘‘normal” ways, as meas- 
ured by a test of immediate recall. No 
method was superior to any other one. 

To what extent can these conclusions 
be generalized? Certainly there are lim- 
itations here. In the first place this was a 
‘‘one-shot” affair, and the attendant pos- 
sible novelty effects might have influ- 
enced unduly the televised instruction 
group, although it would be difficult to 



TABLE III 
Analysis of Variance 





Sum of 




Mean 




Source of Variation 


Squares 


d.f. 


Square 


F 


Between Treatments: A,B,C,D. 
Within Treatments 


13.64 

45 ?- 5 6 


5 

96 


4*55 

4.76 


.96* 



•Not Significant 
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say in wliat direction! This question has 
been examined in a number of other 
settings, however, with variable results.® 
Secondly, it may be that the lecture con- 
tent, the lecturer himself, or the unique 
nature of the audience — independently 
or in combination — can account for the 
"no difference” results. Thirdly, there 
was no effort in this study to measure 
the delayed recall effects of the various 
modes of presentation. 

The conclusions do suggest, however, 
that we need not be fearful of exposing 
our students to televised instruction on 
an ad hoc basis, in terms of their ability 
to learn from such instruction. In fact, 

0 Allen, op. cit. 



it may be the most efficient method in 
terms of time and energy, when the ma- 
terial to be presented is especially perti- 
nent or unique in some way and the 
television lecturer is particularly expert 
and competent. The use of televised in- 
struction obviously assumes that a choice 
of instructional media is possible — that 
the physical facilities for transmitting 
and receiving such instruction exist. 
Although the results of this study cannot 
speak to the question of whether or not 
televised instruction is desirable as a 
regular diet, they do confirm the point 
that there is no reason to condemn it as 
an inferior method of instruction, within 
the boundaries of this experiment. 
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